Examinee equipment, test managing server, test progressing method of examinee equipment, and test analyzing method of test managing server

ABSTRACT

The present invention provides an apparatus and a method for providing a practical question solving exercise and question solving habit correction using an equipment of an examinee in preparation for a multiple choice test.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to an apparatus and a method for providinga practical question solving exercise and a question solving habitcorrection using an equipment of an examinee in preparation for amultiple choice test.

2. Description of the Prior Art

A test sheet is provided in the course of performing scoring inelementary, middle, and high schools, a university entrance examination,the College Scholastic Ability Test, various certified qualificationtests, a driver's license test, and the like and an Optical Mark Reader(OMR) card is used for writing answers for a multiple choice test.

Test takers, who prepare for entrance and qualification tests, needquestion solving practice in the same manner as an actual test inaddition to learning. However, there is no way to have question solvingpractice in the same manner as an actual test other than mock testsintermittently provided by specific institutes.

In the mock test, only result information on the obtained scores isprovided, and wrong habits and errors in solving the questions may notbe recognized. For example, in the test, in addition to solving methodsto correct answers, proper time distribution may be important. However,in the conventional mock test providing test sheets and using an OMRcard, only the final result may be known and how much time the examineetook on each question may not be known.

SUMMARY OF THE INVENTION

Accordingly, the present invention has been made to solve theabove-mentioned problems occurring in the prior art, and an object ofthe present invention is to provide an apparatus and a method forproviding an actual practice and a question solving habit correctionpractice for learners and educational institutions.

In order to accomplish this object, there is provided an examineeequipment. The examinee equipment includes an input unit that receivesanswers input by an examinee; a display unit that displays at least oneof a test sheet generated based on test sheet setting information and ananswer sheet generated based on answer sheet setting information anddisplays the answers input by the examinee on at least one of the testsheet or the answer sheet; a controller that measures question-specifictime taken in inputting an answer for each question by the examinee withrespect to each question; and a communication unit that transmits testinformation of the examinee including information on the answers inputby the examinee and information on the question-specific time.

In accordance with another aspect of the present invention, there isprovided a test managing server. The test managing server includes acommunication unit that receives information on answers input by anexaminee from an examinee equipment; and a test scoring unit that scoresand analyzes the answer based on test information of the examineeincluding information on the answers input by the examinee andinformation on question-specific time taken in inputting an answer foreach question by the examinee.

In accordance with another aspect of the present invention, there isprovided a test progressing method executed in an examinee equipment.The test progressing method includes displaying at least one of a testsheet and an answer sheet; receiving and displaying answers input by theexaminee; measuring question-specific time taken in inputting an answerfor each question by the examinee with respect to each question; andtransmitting test information of the examinee including information onthe answers input by the examinee and information on thequestion-specific time to the test managing server.

In accordance with another aspect of the present invention, there isprovided a test analyzing method executed by a test managing server. Thetest analyzing method includes receiving information on answers input byan examinee from an examinee equipment; and scores and analyzes theanswers based on test information of the examinee including informationon the answers input by the examinee and information onquestion-specific time taken in inputting an answer for each question bythe examinee.

According to the present invention described above, an actual practiceand a question solving habit correction practice are possible forlearners and educational institutions.

BRIEF DESCRIPTION OF THE DRAWINGS

The above and other objects, features and advantages of the presentinvention will be more apparent from the following detailed descriptiontaken in conjunction with the accompanying drawings, in which:

FIG. 1 is a diagram illustrating an example of a test system to whichembodiments of the present invention are applied;

FIG. 2 is a block diagram illustrating a configuration of an examineeequipment in FIG. 1;

FIG. 3 is a diagram illustrating examples of a test sheet and an OMRanswer sheet displayed on the examinee equipment according to a firstembodiment of the present invention;

FIGS. 4 and 5 are diagrams illustrating examples of a method ofmeasuring question-specific time;

FIGS. 6 and 7 are diagrams illustrating data transmitted from anexaminee equipment to the test managing server;

FIG. 8 is a block diagram illustrating a configuration of a testmanaging server of FIG. 1;

FIGS. 9 and 10 are diagrams illustrating examples of solving patterncheck screens;

FIG. 11 is a diagram illustrating an example of detailedquestion-specific pattern analysis;

FIG. 12 is a flowchart illustrating a method according to a firstembodiment of the present invention;

FIG. 13 is a diagram illustrating an example of an applicationinformation input screen displayed on an examinee equipment according toa second embodiment;

FIG. 14 is a diagram illustrating an example of an OMR answer sheetdisplayed on the examinee equipment according to the second embodiment;

FIG. 15 is a diagram illustrating an example of a test result screendisplayed on the examinee equipment according to the second embodiment;

FIG. 16 is a diagram illustrating an example of a scoring screendisplayed on the examinee equipment according to the second embodiment;and

FIG. 17 is a flowchart illustrating a method according to the secondembodiment.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

Hereinafter, exemplary embodiments of the present invention will bedescribed with reference to the exemplary drawings. In the followingdescription, the same elements will be designated by the same referencenumerals although they are shown in different drawings. Further, in thefollowing description of the present invention, a detailed descriptionof known functions and configurations incorporated herein will beomitted when it may make the subject matter of the present inventionrather unclear. In addition, terms, such as first, second, A, B, (a),(b) or the like may be used herein when describing components of thepresent invention. Each of these terminologies is not used to define anessence, order or sequence of a corresponding component but used merelyto distinguish the corresponding component from other component(s). Itshould be noted that if it is described in the specification that onecomponent is “connected,” “coupled” or “joined” to another component, athird component may be “connected,” “coupled,” and “joined” between thefirst and second components, although the first component may bedirectly connected, coupled or joined to the second component.

FIG. 1 is a diagram illustrating an example of a test system to whichembodiments of the present invention are applied.

With reference to FIG. 1, the test system includes an examinee equipment10 provided for an examinee, a test managing server 20 connected to theexaminee equipment 10 through a network 30, and a teacher equipment 40connected to the test managing server 20 through the network.

The examinee equipment 10 is an equipment provided for each examinee.The examinee equipment 10 is an electric apparatus that can communicatethrough the network, and an example thereof may be a desktop computer, alaptop computer, a tablet PC, a PDA, a smart phone, or the like, but isnot limited thereto. The examinee equipment 10 may be an apparatusdedicated to a test provided by a test presenter, or may be ageneral-purpose apparatus with an application for the test which may beprovided by the test presenter or possessed by the examinee.

The examinee equipment 10 realizes a digital Optical Mark Reader (OMR)answer sheet which is identical or similar to a real OMR card. Theexaminee may input an answer using the OMR answer sheet of the examineeequipment 10 in a mock test or a question solving learning process.

Alternatively, the examinee equipment 10 realizes a digital test sheetwith a design identical or similar to a real test sheet. The examineemay input an answer using the test sheet of the examinee equipment 10 inthe mock test or the question solving learning process.

Further, the examinee equipment 10 may realize the digital OMR answersheet and the digital test sheet at the same time.

The test managing server 20 may transmit at least one of theconfiguration information of the OMR answer sheet and the configurationinformation of the test sheet, to the examinee equipment 10.Furthermore, the test managing server 20 may receive informationrelating to the input content to at least one of the OMR answer sheetand the test sheet of the examinee equipment 10. The test managingserver 20 may score the test based on the information relating to theOMR answer sheet or the information relating to the test sheet receivedfrom the examinee equipment 10, and analyze the question solving habitsof each examinee. The content analyzed by the test managing server 20may be transmitted to the teacher equipment 40 to be used for educationby the teacher.

The network 30 that connects the examinee equipment 10 and the testmanaging server 20 may be a wired or wireless Internet network.Alternatively, the network 30 may be a Personal Area Network (PAN) suchas the Institute of Electrical and Electronics Engineers (IEEE)802.15.x, Zigbee, Internet Engineering Task Force (IETF), Routing OverLow power and Lossy networks (ROLL), and International Society ofAutomation (ISA) 100.11a, or a Local Area Network (LAN) such as PowerLine Communication (PLC), Meter-BUS (M-BUS), a wireless M-BUS, and KNX.

FIG. 2 is a block diagram illustrating a configuration of an examineeequipment in FIG. 1.

With reference to FIG. 2, the examinee equipment 10 includes acommunication unit 110 that communicates with the test managing server20 through the network 30, an input unit 120 that receives answers inputby the examinee, a display unit 130 that displays at least one of thetest sheet and the answer sheet, and displays answers input by theexaminee on the at least one of the test sheet and the answer sheet, anda controller 140.

The input unit 120 may include an input apparatus used in an electronicapparatus such as a mouse, a touch screen, and a keypad. The examineemay input answers through the input unit 120.

The display unit 130 may display a test sheet or an answer sheet in anOMR format. The test sheet or the answer sheet displayed on the displayunit 130 may be generated based on the test sheet setting information orthe answer sheet setting information received from the test managingserver 20 through the communication unit 110. For example, the testsheet setting information may include information on test subjects,questions, answers for each question, or the like, and the answer sheetsetting information may include test subjects, the number of questions,the number of answers for each question, or the like. Further, thedisplay unit 130 may display answers input by the examinee through theinput unit 120. When a touch screen is used, the input unit 120 and thedisplay unit 130 may be the same configuration.

FIG. 3 is a diagram illustrating a screen displayed on the display unit130 of the examinee equipment according to the first embodiment.

With reference to FIG. 3, the OMR answer sheet displayed on the displayunit 130 includes initial screens 200, an answer sheet screen 300 and/ora test sheet screen 400.

The initial screen 200 may include a test type selection window 210, atest selection window 220, a test case selection window 230, and a testtaking button 240. The test type selection window 210 is a window onwhich kinds of tests (for example, a mock test) or a test subject can beselected. The test selection window 220 is a window on which detailedinformation about the test (for example, a test providing organization)may be selected. The test case selection window 230 is a window on whicha test case (an odd numbered case or an even numbered case) can beselected. The test taking button 240 is a button for taking a test afterthe examinee makes selections in the test type selection window 210, thetest selection window 220, the test case selection window 230, and thelike. The test type selection window 210, the test selection window 220,the test case selection window 230, and the test taking button 240 aredescribed as examples, and the present invention is not limited thereto.

For example, if the examinee taps the test taking button 240, thedisplay unit 130 may be converted to the answer sheet screen 300 or thetest sheet screen 400.

Alternatively, the initial screen may include a QR code window. The QRcode window may display a QR code captured by a camera (not illustrated)of the examinee equipment 10. The QR code captured by the examineeequipment 10 may be displayed on a material (for example, a test sheet)provided to the examinee or the like. If the QR code is displayed on theQR code window, the display unit 130 may be converted to the answersheet screen 300 or the test sheet screen 400 corresponding to the QRcode.

With reference to FIG. 3, the answer sheet screen 300 may include aquestion number 310, answer input boxes 320 for each question, atry-again check box 330 for each question, a try-later check box 340 foreach question, input pen selection boxes 350 and 360, a time displaywindow 370, and a submit answer window 380.

The examinee may check an answer which is thought to be a correct answeramong the answer input boxes 320 corresponding to the question number310 for each question.

The try-again check box 330 is a window which can be checked by theexaminee if the examinee inputs the answer to the answer input boxes 320with respect to the uncertain question and wants to review the answerlater. The try-again check box 330 may be activated to be checked afterthe examinee inputs an answer to an answer input box 320.

The try-later check box 340 is a window which can be checked by theexaminee, if the examinee does not input an answer to an answer inputbox 320 with respect to an uncertain question, and wants to input ananswer later. The try-later check box 340 may be activated to be checkedonly before an answer is input to an answer input box 320 by theexaminee.

The input pen selection box may include a marker pen selection box 350and a computer sign pen selection box 360, and a user may select any oneof those. That is, if the user selects the marker pen selection box 350,the selection of the computer sign pen selection box 360 may bereleased, and if the computer sign pen selection box 360 is selected,the selection of the marker pen selection box 350 may be released.

When the marker pen selection box 350 is selected, if the examineeinputs an answer to an answer input box 320, the selected answer may bedisplayed to be red. Meanwhile, when the computer sign pen selection box360 is selected, if the examinee inputs an answer to an answer input box320, the selected answer may be displayed in black.

The answer displayed to be red may not be regarded as a real answerselected by the examinee when the answer is scored. In contrast, theanswer displayed to be black may be regarded as a real answer selectedby the examinee when the answer is scored. The examinee may mark ananswer basically in black (computer sign pen) and mark an example whichwas once considered to be marked as an answer but was not marked inblack, in red (marker pen). Meanwhile, it is possible to activate thetry-again check box 330 for an input, only when the examinee checks theanswer input boxes 320 in red.

Alternatively, the input pen selection box may include a pencilselection box and a computer sign pen selection box, and the user mayselect any one of them. The answer input by the examinee to the answerinput boxes 320 when the pencil selection box is selected may bedisplayed to be different from an answer input to the answer input boxes320 by the examinee when the computer sign pen selection box isselected. For example, when the computer sign pen selection box isselected, the answer may be darker than when the pencil selection box isselected.

The answer displayed with the pencil and the answer displayed with thecomputer sign pen may be regarded as real answers selected by theexaminee. However, a configuration can be made so that if the answer isselected with the computer sign pen, the answer may not be modified, butif the answer is selected with the pencil, the answer may be modified.

Alternatively, the input pen selection box may include a marker penselection box and a pencil selection box.

The marker pen selection box, the computer sign pen selection box, andthe pencil selection box are described as examples, and it is possibleto provide another type of input method.

The time display window 370 may display a total test time, a durationtime, a remaining time, and the like. The time display window 370 maydisplay the total test time, the duration time, and the remaining timewith graphics or text.

A submit answer button 380 is a button which is tapped by the examineewhen the examinee finishes the test and submits answers. For example,the submit answer button 380 may be activated after all the questionsare checked in black. Alternately, if the submit answer button 380 istapped when all the questions are not checked in black, a window thatconfirms whether the answers are to be submitted or not may begenerated.

Further, if the examinee taps the test taking button 240, the displayunit 130 may be converted to the test sheet screen 400. With referenceto FIG. 3, the test sheet screen 400 may include a question 410, ananswer 420 for each question, a check box 430 for each question, inputpen selection boxes 450 and 460, a time display window 470, and a submitanswer window 480.

The examinee may read a question and answers for the question, and mayselect an answer considered to be a correct answer. In order todifferentiate other answers with the answer selected by the examinee,the answer selected by the examinee may be displayed differently. Withreference to FIG. 3, for example, a check mark may be displayed on thenumber selected by the examinee.

The check box 430 is a window that can be checked by the examinee whenthe examinee inputs an answer to the uncertain question and wants toreview the answer, or can be checked by the examinee when the examineedoes not input an answer and wants to input the answer later, withrespect to an uncertain question by the examinee.

FIG. 3 illustrates one check box 430, but it is possible to use one ormore check boxes with special functions such as a try-again check boxused for reviewing an answer after the answer is input or a try-latercheck box used for inputting an answer later. For example, it ispossible that the try-again check box is activated only after theexaminee selects an answer and the try-later check box is activated onlybefore the examinee selects an answer.

The input pen selection box may include a marker pen selection box 450and a computer sign pen selection box 460, and the user may select atleast one of those. That is, if the user selects the marker penselection box 450, the selection of the computer sign pen selection box460 is released, and if the user selects the computer sign pen selectionbox 460, the selection of the marker pen selection box 450 may bereleased.

If the marker pen selection box 450 is selected, when the examineeselects an answer, the selected answer may be checked in red. Meanwhile,if the computer sign pen selection box 460 is selected, when theexaminee selects an answer, the selected answer may be checked in black.

The answer checked in red may not be considered as a real answer whichis not selected by the examinee when the answer is scored. Meanwhile,the answer checked in black may be considered as a real answer which isselected by the examinee when the answer is scored. The examinee checksan answer basically in black (computer sign pen), and check an examplewhich was considered to be marked as an answer other than the answerchecked in black, in red (marker pen). Meanwhile, it is possible toactivate the try-again check box 330 for an input, only when theexaminee checks the answer in red.

The time display window 470 may display a total test time, a durationtime, a remaining time, and the like. The time display window 470 maydisplay the total test time, the duration time, the remaining time, andthe like with graphics and text.

A submit answer button 480 is a button which is tapped by the examineewhen the examinee finishes the text and submits the answer. For example,the submit answer button 480 may be activated after the answer ischecked in black with respect to all the questions. Otherwise, if thesubmit answer button 480 is tapped when all the questions are notchecked in black, a window that confirms whether the answers are to besubmitted or not may be generated.

According to another embodiment, if the examinee taps the test takingbutton 240, the display unit 130 may simultaneously display the answersheet screen 300 and the test sheet screen 400. Alternatively, thedisplay unit 130 displays one of the answer sheet screen 300 and thetest sheet screen 400 according to the selection of the examinee, andthe answer sheet screen 300 and the test sheet screen 400 may besubstituted with each other according to the instruction of theexaminee.

According to the present embodiment, when the examinee checks an answerinput box 320 of the answer sheet screen 300, a corresponding answer 420of the test sheet screen 400 may be checked or when the examinee selectsan answer 420 of the test sheet screen 400, an answer input box 320corresponding to the answer sheet screen 300 may be checked.

With reference to FIG. 2, the controller 140 may generate the examinee'stest information based on the information input by the examinee throughthe input unit 120. The examinee's test information may includeinformation on answers input by the examinee, question-specific timetaken by the examinee with respect to each question, information on thetotal time taken by the examinee for all questions, information on asequence in which the examinee input the answers for the questions,information on whether the examinee performed a try-again or try-laterinput for checking uncertain questions, and the like.

FIG. 4 is a diagram illustrating an example of a method of measuringquestion-specific time.

In FIG. 4, the examinee inputs answers in a sequence of question numbers3, 4, and 2, after the test starts. At this point, the time on thequestion first solved by the examinee (question number 3) may be a timefrom the test start time to the time of inputting an answer to thecorresponding question (question number 3). Otherwise, the time on thequestion which is not solved first (for example, question number 4) maybe a time from the time of inputting an answer to the previous question(question number 3) to the time of inputting an answer to thecorresponding question (question number 4).

FIG. 5 is a diagram illustrating another example of a method ofmeasuring question-specific time.

FIG. 5 illustrates a method of measuring question-specific time when theexaminee performs a try-again or try-later input. In FIG. 5, theexaminee inputs an answer to question number 4 after inputting an answerto question number 3, and checks a try-again box, since the answer toquestion number 4 is uncertain. Thereafter, the examinee inputs ananswer to question number 4, after inputting an answer to questionnumber 50. In this case, the time for question number 4 may be a timeobtained by adding a time from the time of inputting the answer to theprevious question (question number 3) to the time of checking atry-again box for the corresponding question (question number 4), and atime from the time of inputting an answer to the previous question(question number 50) to the time of inputting an answer to thecorresponding question (question number 4).

Further, if the try-later box is checked, in a similar manner to thetry-again box, the time may be obtained by adding a time from the timeof inputting the answer to the previous question to the time of checkinga try-later box for the corresponding question, and a time from the timeof inputting an answer to the previous question to the time of inputtingan answer to the corresponding question.

Meanwhile, the time on a question which is solved after the question forwhich a try-again or try-later box is checked may be calculated based onthe time at which the try-again or try-later box is checked.

Further, the examinee's test information may include information ontotal time by the examinee on all questions. The total time may be atime from when the test starts to when the answer submit button 380 istapped. Otherwise, the total time may be the sum of thequestion-specific time.

Alternatively, the examinee's test information may include informationon a sequence of inputting answers for questions by the examinee.

Further, the examinee's test information may include information onwhether a try-again or try-later box for each question was checked ornot for checking an uncertain question.

Further, the examinee's test information may include information onanswers marked in red in addition to answers marked in black.

The examinee's test information described above may be transmitted tothe test managing server 20 by the communication unit 110 when theexaminee taps a submit answer button 380 or 480.

FIGS. 6 and 7 are diagrams illustrating data including the examinee'stest information in an examinee equipment and transmitted to the testmanaging server.

In FIG. 6, the data may include information on the total time, andinformation on a sequence of solving questions. Further, the data mayinclude information on a marked answer for each question, information ona try-again or try-later input, information on question solving time,and information on answer changes. In FIG. 6, the examinee's testinformation may be transmitted in a form arranged by the controller 140of the examinee equipment 10.

In FIG. 7, the data may include contents input by the examinee accordingto time. The data include all actions input by the examinee arranged bytime. In FIG. 7, the arranged form of the examinee's test informationmay be extracted from the test managing server.

FIG. 8 is a block diagram illustrating a configuration of a testmanaging server 800 according to an embodiment of the present invention.

With reference to FIG. 8, the test managing server 800 includes acommunication unit 810, a question database 820, and a scoring unit 830.

The communication unit 810 is configured to communicate with an examineeequipment through a network. Further, the communication unit 810 can beused to communicate with a teacher equipment described below.

The question database 820 includes data on questions of the testsperformed by the examinee and data on correct answers thereof.

According to kinds of tests taken by the examinee, test sheetconfiguration information or answer sheet configuration information maybe generated based on data (for example, the number of questions, thenumber of answers) on the test questions stored in the question database820. Such test sheet setting information or answer sheet settinginformation may be transmitted to the examinee equipment through thecommunication unit 810.

Based on the information on the correct answers in the test taken by theexaminee, the scoring unit 830 may score answers of the examinee.

Further, the question database 820 may include information on attributesof each question. The question attribute information may includedifficulty of questions (for example, high, middle, low), types ofquestions (for example, understanding, application, or advanced), unitinformation, or the like. The information on the units may behierarchically configured into a category, a division, and a section.The question attribute information may be used for analyzing theexaminee's test result and counseling the examinee.

The scoring unit 830 scores answers of the examinee using the examinee'stest information received from the examinee equipment.

Further, the scoring unit 830 may perform analysis and statistics basedon the examinee's test information to provide the analysis statisticsinformation. In more detail, the scoring unit 830 may provideinformation relating to the examinee's question solving habit andinformation relating to scores. For example, the analysis statisticsinformation provided by the scoring unit 830 may be as presented inTable 1 below.

TABLE 1 Question solving pattern information Information relating toscores Time measurement function Result score Solution sequenceCorrect/incorrect answers for each Uncertain question advance questioncheck function Incorrect answer question number set Uncertain questionnumber set Weak unit Question-specific pattern comparison

The time measurement function may be used to determine whether theexaminee manages test time effectively.

The solution sequence may be used to determine the test habits of theexaminee along with the question attribution information. For example,the solution sequence may be used to determine whether the solutionsequence has a correlation with the distributed points for the question,the difficulty, the unit, and the like.

The uncertain question advance check function may be used to determinewhether the examinee checks unsure questions in advance to take the testcautiously.

The result score refers to the test score of the examinee.

The correct/incorrect answer for each question refers to whether theexaminee selects a correct answer or an incorrect answer for eachquestion.

The incorrect answer question number set provides questions for whichthe examinee inputs incorrect answers.

The uncertain question number set provides questions selected by theexaminee during a solving process by marking try-again or try-laterboxes with respect to uncertain questions. Regardless of whether theanswer is correct or incorrect, since the examinee is uncertain, thequestions may be provided as information.

The weak unit may present a unit name corresponding to the question forwhich an incorrect answer is input or a unit name corresponding to thequestion of which the examinee is uncertain. In addition to the weakunit, it is possible to provide a weak type that presents a type (forexample, understanding, application, or advanced) corresponding to aquestion for which an incorrect answer was input or which is uncertain.

The question-specific pattern comparison may be provided by analyzingpattern information of all test taking students with respect to eachquestion. For example, the question-specific pattern comparison may beas presented in Table 2 below.

TABLE 2 Question-specific pattern comparison Answer selected by examineeQuestion solving time of examinee Actual correct answer Average questionsolving time of all Correct/Incorrect examinee Percentage of correctanswers Whether examinee checks try- out of entire examineesagain/try-later Percentage of correct answers Percentage of examineeswho checks out of high-level examinees try-again/try-later out of allexaminees

The analysis statistics information described above may be provided to ateacher equipment to be used when the teacher counsels the examinee orbe provided to an examinee equipment so that the examinee may checkhis/her own question solving habits. The details of the analysisstatistics information provided with the teacher equipment and theexaminee equipment may be different.

FIGS. 9 and 10 are diagrams illustrating examples of solving patterncheck screens displayed on a teacher equipment.

With reference to FIG. 9, the solving pattern check screen may includeinformation such as a question solution sequence, whether the examiner'sanswer for each question is correct or incorrect, a percentage ofcorrect answers out of all examinees, question solving time by theexaminee, average question solving time by all examinees, averagequestion solving time by high-level examinees (for example, top 1%examinees), total time, remaining time, difficulty, a question type,distributed points, and a unit.

With reference to FIG. 10, the solving pattern check screen may providethe number of questions, scores, and time with respect to questions thatthe examinee knows, questions that the examinee does not know, orquestions of which the examinee is uncertain. The uncertain questionsmay correspond to the number of questions for which a try-again ortry-later box is marked by the examinee. Alternatively, the uncertainquestions may correspond to the number of questions of which answersmarked by the examinee are changed.

FIG. 11 is a diagram illustrating a screen of detailed question-specificpattern analysis displayed on a teacher equipment.

With reference to FIG. 11, the screen of detailed question-specificpattern analysis includes answers selected by the examinee, actualcorrect answers, whether answers are correct or incorrect, a percentageof correct answers out of all examinees, question solving time by theexaminee, average question solving time by all examinees, whethertry-again or try-later boxes are marked or not, a percentage ofexaminees who marked try-again or try-later boxes out of all examinees,whether marking is performed with a marker pen (red), and the like.

FIGS. 10 and 11 are diagrams illustrating analysis results with respectto each examinee.

Further, information displayed on the teacher equipment may beinformation on all examinees (for example, the number of examinees, anaverage score of all examinees, an average score of high-levelexaminees, an average solving time of all examinees, and an averagesolving time of high-level examinees) or question-specific analysisinformation (for example, with respect to each question, correctanswers, average solving time, a percentage of a correct answers, aselection percentage with respect to each answer, and the like).

FIG. 12 is a flowchart illustrating a test progressing method accordingto a first embodiment of the present invention.

With reference to FIG. 12, the test managing server transmits test sheetsetting information or answer sheet setting information to the examineeequipment in step S1210. The test sheet setting information or theanswer sheet setting information may include a test subject, a testtype, contents of questions or the number of questions, and contents ofanswers or the number of answers for each question.

The examinee equipment generates a test sheet and/or an OMR answer sheetbased on the test sheet setting information or the answer sheet settinginformation in step S1220. More specifically, the examinee equipment maygenerate a test sheet based on the contents of the questions and thecontents of the answers or generate an answer sheet based on the numberof questions and the number of answers. Further, the examinee equipmentmay further display windows for checking try-again or try-later boxesfor each question. In addition, the examinee equipment may furtherdisplay a computer sign pen selection box that can be used to markanswers in black and a marker pen selection box that can be used to markexamples considered to be selected other than the answers marked inblack, in red. Further, the examinee equipment may further display asubmit answer button to submit answers when the examinee completesanswer inputs.

The examinee equipment receives answer signals input by the examinee instep S1230. Further the examinee equipment transmits answer sheetinformation to the test managing server in step S1240.

In addition to the information on answers input by the examinee, theanswer sheet information may include information on a sequence ofquestions for which the examinee inputs answers, information onquestion-specific time which is time used by the examinee to input ananswer for each question, information on whether the examinee checkstry-again or try-later boxes to check uncertain questions, andinformation on whether the examinee selects marker pen selection boxesto mark answers. Such information may be provided as data for counselingthe examinee. The test managing server receives answer sheet informationscores and analyzes the answer sheet of the examinee in step S1250.

The test managing server may analyze question solving patterns of theexaminee such as time taken by the examinee for solving questions, asolution sequence, and advance checks on uncertain questions.

Further, the test managing server analyzes result scores,correct/incorrect answers for each question, questions for whichincorrect answers are input or which are uncertain (questions for whichtry-again or try-later boxes are checked), and units relating to thequestions for which the incorrect answers are input or which areuncertain (questions for which try-again or try-later boxes arechecked).

Further, the test managing server may analyze a question-specificpattern comparison with respect to each question. The question-specificpattern comparison may include answers selected by the examinee, actualcorrect answers, whether answers are correct or incorrect, a percentageof correct answers out of all examinees, question solving time of theexaminee, an average question solving time of all examinees, whether theexaminee selects try-again or try-later boxes, and a percentage ofexaminees who select try-again or try-later boxes out of all examinees.

The score and analysis result may be provided to the teacher equipmentin step S1260 so that the teacher may use the score and analysis resultfor counseling. Further, the score and analysis result may be providedto the examinee equipment so that the examinee can refer to the scoreand analysis result.

The analysis statistics information described above can be applied to anactual question solving exercise in preparation for tests by examineesor educational institutions. Therefore, test taking patterns may beanalyzed which was not possible in conventional paper test sheets orpaper OMR answer sheets. The analysis result may be used as helpfulinformation by teachers in educational institutions to recognizequestion solving habits of examinees and teach the examinees.

The analysis statistics information function of the OMR answer sheet isapplicable to general workbooks in addition to question solvingexercises such as mock tests, so the analysis statistics informationfunction may be utilized in combination with paper teaching materials inthe publishing industry. For example, using an equipment that canconnect to a server through a network and display a digital OMR screen,solutions to questions of the paper teaching material (workbook) can beprovided.

Such digital test sheets or digital OMR answer sheets may be used forall kinds of multiple choice test exercises, and may be used byexaminees and institutions that provide services providing solutions toquestions relating to tests since the digital test sheets or digital OMRanswer sheets provide information which was not possible to berecognized so far.

The embodiment described above suggests providing OMR answer sheets ordigital test sheets to the examinee equipment 10 by the test managingserver 20 in FIG. 1. Meanwhile, according to a second embodiment, theexaminee equipment 10 may progress tests without an OMR answer sheetprovided by the test managing server 20. In this case, the progress ofthe test is described as follows.

FIG. 13 is a diagram illustrating an application information inputscreen displayed on an examinee equipment according to a secondembodiment.

With reference to FIG. 13, an application information input screen 1300includes a test name input box 1310, a name input box 1320, a genderinput box 1330, a grade input box 1340, a school input box 1350, aninstitute input box 1360, and a confirm button 1370.

The test name input box 1310 is used to input a test which the examineecurrently wants to take. The examinee may input a test name by selectingone among a plurality of tests set in advance or by inputting the testname directly.

For example, the answer sheet may be set according to the test nameinput to the test name input box 1310.

For example, as described in Table 3 below, if a test type and asection/subject are input to the test name input box 1310, the number ofquestions, a question configuration, test time, preliminary marking, andthe like may be determined in advance.

TABLE 3 Prelimi- Section/ Number of Question Test nary Test type Subjectquestions configuration time marking Mock test Korean 45 All multiple 80Pencil of College (Case A/ choice minutes Scholastic Case B) questionsAbility Math 30 21 multiple 100  Pencil Test and (Case A/ choice minutesAcademic Case B) questions assessment (Nos. 1 to test (high 21) +9short- school) answer questions (Nos. 22 to 30) English 50 All multiple70 Pencil (Case A/ choice minutes Case B) questions Social 20 Allmultiple 30 Pencil Studies/ choice minutes Science questions

For example, if the examinee selects a mock test of the CollegeScholastic Ability Test and a math section in the test name input box1310, an OMR answer sheet for 21 multiple choice questions and 9short-answer questions is generated and displayed subsequently. At thispoint, the test time is set to be 100 minutes, and the preliminarymarking may be implemented with a pencil before the final marking.

Otherwise, a configuration may be possible so that the examinee maydirectly input at least one kind of information such as the number ofquestions, a question configuration, test time, and preliminary marking.

With reference to FIG. 13, the name input box 1320, the gender input box1330, the grade input box 1340, the school input box 1350, the instituteinput box 1360, and the like may be used to input information of theexaminee. The examinee may select or directly input one of a pluralityof configurations to the name input box 1320, the gender input box 1330,the grade input box 1340, the school input box 1350, and the instituteinput box 1360

The examinee taps the confirm button 1370 when the inputs of theapplication information input screen 1300 are completed. Thereafter, thetest taker progresses the test using an OMR answer sheet displayed onthe examinee equipment.

FIG. 14 is a diagram illustrating an OMR answer sheet displayed on theexaminee equipment.

With reference to FIG. 14, the OMR answer sheet includes a testinformation display window 1410, a time display window 1420, an inputpen selection box 1430, a question number 1440, an answer input box 1450for each question, a test cancel button 1460, a pause button 1470, and asubmit answer button 1480.

The test information display window 1410 may display information inputin the test name input box 1310.

The time display window 1420 may display total test time, duration time,remaining time, and the like.

The input pen selection box 1430 may be provided to select marking whenthe final answers are submitted (for example, a computer sign pen),preliminary marking (for example, a red color marker pen or a pencil),or an eraser to erase the input marking.

The examinee may check an answer which is considered to be a correctanswer among answer input boxes 1450 corresponding to the questionnumber 1440 for each question.

The test cancel button 1460 is a button tapped when the examinee cancelsthe test, and the pause button 1470 is a button tapped when the examineepauses the test.

The submit answer button 1480 is a button tapped by the examinee whenthe examinee completes the test and submits answers.

When the examinee completes answer inputs and submits answers by tappingthe submit answer button 1480, the test result screen may be displayedon the examinee equipment.

FIG. 15 is a diagram illustrating an example of a test result screendisplayed on the examinee equipment.

With reference to FIG. 15, a test result screen 1500 includes a testinformation display window 1510, a test result information displaywindow 1520, a pattern-per-question display window 1530, a scoring-laterbutton 1540, and a scoring button 1550.

The information input in the test name input box 1310 in FIG. 13 may bedisplayed on the test information display window 1510.

The test result information display window 1520 may display allowed testtaking time, test taking time actually taken by the examinee, allquestions, questions actually marked by the examinee, an averagequestion-specific solving time, and the like.

The pattern-per-question display window 1530 may display an answer inputby the examinee for each question and question-specific time. Thequestion-specific time may be calculated as described above withreference to FIGS. 4 and 5.

The scoring-later button 1540 is a button tapped to score answers later.

The scoring button 1550 is a button tapped to score answers by theexaminee. When the examinee taps the scoring button 1550, the scoringscreen may be displayed on the examinee equipment.

Alternatively, a scoring button may be positioned on the OMR answersheet of FIG. 14. In this case, the examinee may proceed to scoreanswers right after submitting answers, and the test result screen ofFIG. 15 may be omitted. Alternately, a screen obtained by combining thetest result screen of FIG. 15 with a scoring screen to be describedbelow may be displayed.

FIG. 16 is a diagram illustrating a scoring screen displayed on theexaminee equipment.

With reference to FIG. 16, a scoring screen 1600 may include a testinformation display window 1610, a question number 1620, a marked answer1630, a correct answer 1640, a distributed point setting window 1650,and the scoring completion button 1660.

The information input to the test name input box 1310 in FIG. 13 may bedisplayed on the test information display window 1610.

Answers which the examinee input in the OMR answer sheet in FIG. 14 withrespect to each of the question numbers 1620 may be displayed as themarked answers 1630. Further, the examinee may directly input thecorrect answer 1640 of the test. If the marked answer 1630 is identicalto the correct answer 1640, it is determined that the marked answer 1630is correct, and if the marked answer 1630 is not identical to thecorrect answer 1640, it is determined that the marked answer 1630 isincorrect.

The distributed point setting window 1650 is positioned to set aquestion-specific distributed point. The examinee that scores theanswers may set a distributed point corresponding to the distributedpoint setting window 1650.

The scoring completion button 1660 may be tapped when the examineecompletes the scoring. The scoring completion button 1660 may beconfigured to be activated when the examinee performs the scoring withrespect to all the questions.

When the scoring completion button 1660 is tapped, a total score iscalculated based on whether the marked answer 1630 and the correctanswer 1640 are identical to each other with respect to each questionand distributed points 1650, and the examinee may check the calculatedtotal score.

Further, when the scoring is completed, the test information of theexaminee may be transmitted from the examinee equipment 10 to the testmanaging server 20. The information transmitted to the test managingserver 20 may include test information (input to the test name input box1310 in FIG. 13), information of the total time, information onquestion-specific time, information on a sequence of solving thequestions, information on marked answers for each question, informationon correct answers for each question, information on whether theexaminee input a correct answer for each question, question-specificdistributed points, information on whether the examinee performedpreliminary marking for each question, information on whether theexaminee modified the marking for each question, and the like.

The test managing server 20 may perform analysis and statistics based oninformation received from the examinee equipment 10, and provideanalysis statistics information. More specifically, the test managingserver 20 may provide information on question solving patterns of theexaminee and information on scores. As described above with reference toTable 1, information on the question solving patterns may include a timemeasurement function, a solution sequence, an uncertain question advancecheck function, and the like may include a result score,correct/incorrect answers for each question, an incorrect answerquestion number set, an uncertain question number set, weak units,question-specific pattern comparison, and the like.

The test managing server 20 may find a plurality of examinees that tookthe same test with test information, and analyze and provide patterninformation of all examinees with respect to the same test. As describedabove with reference to FIG. 2, with respect to each question, the testmanaging server 20 may provide answers selected by the examinee, actualcorrect answers, whether answers are correct or incorrect, a percentageof correct answers out of all examinees, a percentage of correct answersout of high-level examinees, question solving time of the examinee, anaverage question solving time of all examinees, whether the examineeperformed preliminary marking, a percentage of preliminary marking outof all examinees, and the like.

The test managing server 20 may provide the analysis statisticsinformation to the examinee equipment 10 or the teacher equipment 40.

FIG. 17 is a flowchart illustrating a test progressing method accordingto the second embodiment of the present invention.

With reference to FIG. 17, the examinee equipment generates and displaysan answer sheet based on the information input by the examinee in stepS1710.

The information input by the examinee may include information on thetest and the information on the examinee. The number of questions, aquestion configuration, test time, and the like may be determined basedon the information on the test. Otherwise, the information input by theexaminee may include the number of questions, a question configuration,test time, and the like. The examinee equipment may include a window toselect final marking, preliminary marking, and answer modifications.Further, the examinee equipment may display a button to submit answerswhen the examinee completes answer inputs.

The examinee equipment receives answer signals input by the examinee instep S1720, and receives information on the scoring by the examineeafter the completion of the test in step S1730. Further, the examineeequipment transmits information on the answers input by the examinee,and information on the scoring by the examinee to the test managingserver in step S1740.

The information transmitted from the examinee equipment to the testmanaging server may include the name of the test, information on thetotal time, information on question-specific time, information on asequence of solving questions, information on marked answers for eachquestion, information on correct answers for each question, informationon correct/incorrect answers for each question, information onquestion-specific distributed points, information on whether theexaminee performed preliminary marking for each question, information onwhether the examinee modified marking for each question, and the like.

The test managing server analyzes answers based on information receivedfrom the examinee equipment in step S1750. The test managing serveranalyzes question solving patterns of the examinee such as timemeasurement, a solution sequence, and uncertain question advancechecking, and information relating to scores such as a result score,correct/incorrect answers for each question, an incorrect answerquestion number set, an uncertain question number set, weak units, andquestion-specific pattern comparison. Further, the test managing servermay analyze pattern information on all examinees by collectinginformation on examinees who took the same test. That is, the testmanaging server may compare a result of the examinees, results of allexaminees, and results of high-level examinees.

Further, the test managing server transmits the scoring and analysisresult to the teacher equipment in step S1760.

The analysis statistics information described above may be applied to apractical question solving exercise in preparation for a test byexaminees and educational institutions. Therefore, test taking patternsmay be analyzed which was not possible in conventional paper OMR answersheets. The analysis result as above may be used as useful informationin recognizing the examinee's question solving habits and teaching theexaminees by teachers in educational institutions.

The analysis statistics information function of the OMR answer sheet isapplicable to general workbooks in addition to question solvingexercises such as mock tests, so the analysis statistics informationfunction may be utilized in combination with paper teaching materials inthe publishing industry. For example, using an equipment that canconnect to a server through a network and display a digital OMR screen,solutions to questions of the paper teaching material (workbook) can beprovided.

Such digital OMR answer sheets may be used for all kinds of multiplechoice test exercises, and may be used by examinees and institutionsthat provide services providing solutions to questions relating to testssince the digital OMR answer sheets provide information which was notpossible to be recognized so far.

The first and second embodiments described above are presented asexamples, and another embodiments combining or modifying the embodimentsmay be possible. For example, the test sheet and/or the answer sheetdisplayed on the examinee equipment may be generated based on settinginformation received from the test managing server as described in thefirst embodiment and the scoring of the answers may be performed in theexaminee equipment as described in the second embodiment. Otherwise, thetest sheets and/or the answer sheets displayed on the examinee equipmentmay be generated based on information input by the examinee as describedin the second embodiment, and the scoring of the answers may beperformed in the test managing server as described in the firstembodiment.

Even if it was described above that all of the components of anembodiment of the present invention are coupled as a single unit orcoupled to be operated as a single unit, the present invention is notnecessarily limited to such an embodiment. That is, among thecomponents, one or more components may be selectively coupled to beoperated as one or more units. In addition, although each of thecomponents may be implemented as an independent hardware, some or all ofthe components may be selectively combined with each other, so that theycan be implemented as a computer program having one or more programmodules for executing some or all of the functions combined in one ormore hardwares. Codes and code segments forming the computer program canbe easily conceived by an ordinarily skilled person in the technicalfield of the present invention. Such a computer program may implementthe embodiments of the present invention by being stored in a computerreadable storage medium, and being read and executed by a computer. Amagnetic recording medium, an optical recording medium, a carrier wavemedium, or the like may be employed as the storage medium.

In addition, since terms, such as “including,” “comprising,” and“having” mean that one or more corresponding components may exist unlessthey are specifically described to the contrary, it shall be construedthat one or more other components can be included. All of theterminologies containing one or more technical or scientificterminologies have the same meanings that persons skilled in the artunderstand ordinarily unless they are not defined otherwise. A termordinarily used like that defined by a dictionary shall be construedthat it has a meaning equal to that in the context of a relateddescription, and shall not be construed in an ideal or excessivelyformal meaning unless it is clearly defined in the presentspecification.

Although a preferred embodiment of the present invention has beendescribed for illustrative purposes, those skilled in the art willappreciate that various modifications, additions and substitutions arepossible, without departing from the scope and spirit of the inventionas disclosed in the accompanying claims. Therefore, the embodimentsdisclosed in the present invention are intended to illustrate the scopeof the technical idea of the present invention, and the scope of thepresent invention is not limited by the embodiment. The scope of thepresent invention shall be construed on the basis of the accompanyingclaims in such a manner that all of the technical ideas included withinthe scope equivalent to the claims belong to the present invention.

What is claimed is:
 1. An examinee equipment, comprising: an input unitthat receives answers input by an examinee; a display unit that displaysat least one of a test sheet generated based on test sheet settinginformation and an answer sheet generated based on answer sheet settinginformation and displays the answers input by the examinee on at leastone of the test sheet or the answer sheet; a controller that measuresquestion-specific time taken in inputting an answer for each question bythe examinee with respect to each question; and a communication unitthat transmits test information of the examinee including information onthe answers input by the examinee and information on thequestion-specific time to a test managing server.
 2. The examineeequipment according to claim 1, wherein the question-specific time is atime from test starting time to time of inputting an answer to acorresponding question if the corresponding question is a firstquestion, and wherein the question-specific time is a time from time ofinputting an answer to a previous question to time of inputting ananswer to a corresponding question if the corresponding question is nota first question.
 3. The examinee equipment according to claim 1,wherein the controller further measures total usage time taken ininputting answers for all questions by the examinee, and wherein thetest information of the examinee further includes information on thetotal usage time.
 4. The examinee equipment according to claim 1,wherein the controller further measures a question sequence of selectinganswer inputs by the examinee, and wherein the test information of theexaminee further includes information on the question sequence ofselecting the answer inputs.
 5. The examinee equipment according toclaim 1, wherein the test sheet or the answer sheet includes a try-againinput box to be checked by the examinee to input an answer of acorresponding question again, and a try-later input box to be checked bythe examinee to input an answer of a corresponding question later, andwherein the test information of the examinee further includesinformation on whether the try-again input box or the try-later inputbox is checked.
 6. The examinee equipment according to claim 5, whereinthe question-specific time includes a time from time of inputting ananswer of a previous question to time of checking the try-again inputbox or the try-later input box.
 7. The examinee equipment according toclaim 1, wherein the controller scores based on a correct answer inputby a user or a distributed point input by the user.
 8. The examineeequipment according to claim 1, wherein the test sheet settinginformation or the answer sheet setting information is determinedaccording to a QR code read by the examinee equipment.
 9. A testmanaging server, comprising: a communication unit that receivesinformation on answers input by an examinee from an examinee equipment;and a test scoring unit that scores and analyzes the answers based ontest information of the examinee including information on the answersinput by the examinee and information on question-specific time taken ininputting an answer for each question by the examinee.
 10. The testmanaging server according to claim 9, wherein the question-specific timeis a time from test starting time to time of inputting an answer to acorresponding question if the corresponding question is a firstquestion, and wherein the question-specific time is a time from time ofinputting an answer to a previous question to time of inputting ananswer to a corresponding question if the corresponding question is nota first question.
 11. The test managing server according to claim 9,wherein the test information of the examinee further includesinformation on the total usage time taken in inputting answers for allquestions by the examinee.
 12. The test managing server according toclaim 9, wherein the test information of the examinee further includesinformation on a question sequence of selecting the answer inputs by theexaminee.
 13. The test managing server according to claim 9, wherein atest sheet or an answer sheet provided for the examinee equipmentincludes a try-again input box to be checked by the examinee to input ananswer of a corresponding question again, or a try-later input box to bechecked by the examinee to input an answer of a corresponding questionlater, and wherein the test information of the examinee further includesinformation on whether the try-again input box or the try-later inputbox is checked with respect to the corresponding question.
 14. The testmanaging server according to claim 13, wherein the question-specifictime includes a time from time of inputting an answer of a previousquestion to time of checking the try-again input box or the try-laterinput box.
 15. A test progressing method executed in an examineeequipment, comprising: displaying at least one of a test sheet and ananswer sheet; receiving and displaying answers input by the examinee;measuring question-specific time taken in inputting an answer for eachquestion by the examinee with respect to each question; and transmittingtest information of the examinee including information on the answersinput by the examinee and information on the question-specific time withrespect to each question, to the test managing server.
 16. The testprogressing method according to claim 15, wherein the question-specifictime is a time from test starting time to time of inputting an answer toa corresponding question if the corresponding question is a firstquestion, and wherein the question-specific time is a time from time ofinputting an answer to a previous question to time of inputting ananswer to a corresponding question if the corresponding question is nota first question.
 17. The test progressing method according to claim 15,further comprising: measuring total usage time taken in inputtinganswers for all questions by the examinee, wherein the test informationof the examinee further includes information on the total usage time.18. The test progressing method according to claim 15, furthercomprising: measuring a question sequence of selecting answer inputs bythe examinee, wherein the test information of the examinee furtherincludes information on the question sequence of selecting the answerinputs.
 19. The test progressing method according to claim 15, whereinthe test sheet or the answer sheet includes a try-again input box to bechecked by the examinee to input an answer of a corresponding questionagain, or a try-later input box to be checked by the examinee to inputan answer of a corresponding question later, and wherein the testinformation of the examinee further includes information on whether thetry-again input box or the try-later input box is checked.
 20. The testprogressing method according to claim 19, wherein the question-specifictime includes a time from time of inputting an answer of a previousquestion to time of checking the try-again input box or the try-laterinput box.
 21. The test progressing method according to claim 15,further comprising: scoring based on a correct answer input by a user ora distributed point input by the user.
 22. The test progressing methodaccording to claim 15, further comprising: determining the test sheetsetting information or the answer sheet setting information according toa QR code read by the examinee equipment.
 23. A test analyzing methodexecuted by a test managing server, comprising: receiving information onanswers input by an examinee from an examinee equipment; and scoring andanalyzing the answers based on test information of the examineeincluding information on the answers input by the examinee andinformation on question-specific time taken in inputting an answer foreach question by the examinee.
 24. The test analyzing method accordingto claim 23, wherein the question-specific time is a time from teststarting time to time of inputting an answer to a corresponding questionif the corresponding question is a first question, and wherein thequestion-specific time is a time from time of inputting an answer to aprevious question to time of inputting an answer to a correspondingquestion if the corresponding question is not a first question.
 25. Thetest analyzing method according to claim 23, wherein the testinformation of the examinee further includes information on total usagetime taken in inputting answers for all questions by the examinee. 26.The test analyzing method according to claim 23, wherein the testinformation of the examinee further includes information on a questionsequence of selecting the answer inputs by the examinee.
 27. The testanalyzing method according to claim 23, wherein a test sheet or ananswer sheet provided for the examinee equipment includes a try-againinput box to be checked by the examinee to input an answer of acorresponding question again, or a try-later input box to be checked bythe examinee to input an answer of a corresponding question later, andwherein the test information of the examinee further includesinformation on whether the try-again input box or the try-later inputbox is checked with respect to the corresponding question.
 28. The testanalyzing method according to claim 27, wherein the question-specifictime includes a time from time of inputting an answer of a previousquestion to time of checking the try-again input box or the try-laterinput box.